Adaptive-Flash Photography, Videography, and/or Flashlight Using Camera, Scene, or User Input Parameters

ABSTRACT

A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.

This application claims benefit of priority to U.S. ProvisionalApplication Ser. No. 63/248,398, entitled “Adaptive-Flash PhotographyUsing Camera and Scene Parameters,” filed Sep. 24, 2021, and which ishereby incorporated herein by reference in its entirety.

BACKGROUND Technical Field

This disclosure relates generally to light source modules which emitlight, including, without limitation, flash modules used to illuminatesubjects in images captured by a camera device.

Background

For small devices, including devices which include one or more miniaturecameras, it is common to include in such devices a light source module,which illuminates at least a portion of a scene located within a fieldof view of the camera of the device. Such cameras and light sourcemodules can be included in a larger electronic device, including amobile electronic device, which can include a mobile telephone,smartphone, notebook, etc.

A light source module, which may also be referred to as a “flash”module, “strobe” module, etc., emits light which illuminates a spaceexternal to the light source module. The illuminated space may include acamera field of view, thereby illuminating subjects within the camerafield of view for images of said subjects captured by the camera.

In some cases, a camera may be designed to capture images of scenes inthe camera's field of view that include objects that are at variousdistances away from the camera, for example via a telephoto lens systemor a wide-angle lens system. In some cases, a camera system may bedesigned to capture images of objects in a scene at a particulardistance away from the camera in one of multiple camera modes, such as awide-angle mode or a telephoto mode. Also, a camera may be designed tocapture images of an object at a particular distance away from thecamera in any number of multiple zoom levels supported by the camera. Insuch cases, a light source module that does not adjust for zoom levels,adjust for distances to objects or adjust for different camera modes mayresult in inadequate, insufficient, or uneven illumination of a scene tobe captured by the camera.

In some cases, a scene may include multiple objects that are atdifferent distances away from the camera and that include differentambient lighting and reflectivity characteristics. In such cases, alight source module that does not adjust illumination across anillumination field may result in uneven illumination of a scene to becaptured by the camera.

SUMMARY

Some embodiments provide a mobile computing device which includes acamera arrangement with one or multiple lens systems. With one lenssystem, there may be different digital zooms achieving different fieldsof views. With multiple lens systems, each may have different fields ofview, such as a wide-angle lens system, a telephoto lens system, and anultra-wide-angle lens system. A field of view of an image captured bythe camera arrangement may be based on a combination of the fields ofview of the different lens systems, such as a combination of a field ofview of a wide-angle lens system and a field of view of a telephoto lenssystem, or a combination of a wide-angle lens system and anultra-wide-angle lens system. In addition, a camera arrangement may beconfigured to capture photos at multiple zoom levels using a combinationof the different lens systems, such as a combination of the telephotolens system and the wide-angle lens system. For example, a cameraarrangement may include a camera with a telephoto lens system andanother camera with a wide-angle lens system, or may include a cameraconfigured to operate both a telephoto lens system and a wide-angle lenssystem to achieve intermediate optical zoom levels between a fulloptical wide-angle mode and a full optical telephoto mode. The mobilecomputing device also includes a light source module embedded in themobile computing device or coupled with the mobile computing device. Thelight source module includes an array of illumination elementsconfigured to emit light through a projection lens. For example, the oneor more illumination elements may be one or more light emitting diodes(LEDs).

The mobile computing device includes a controller configured todetermine respective amounts of light to be emitted from individual onesof the array of illumination elements to focus the illumination fieldsuch that the illumination field of view optimizes illumination of thescene. Note that in some embodiments, the controller may determine anamount of current to be directed to respective ones of the illuminationelements, wherein the amount of light emitted from a given illuminationelement is proportional to the current supplied to the illuminationelement. In some embodiments, a camera arrangement field of viewresulting from a combination of a wide-angle field of view and atelephoto field of view may have a pyramid shape with a focal point ofthe pyramid being the lens or lenses of the lens systems of the cameraarrangement.

Different scenes of objects at different distances within the cameraarrangement field of view may have quadrilateral shapes. As a distancefrom the camera is increased in a composite camera arrangement field ofview, scenes corresponding with cross-sections of the pyramid compositecamera arrangement field of view at the increasing distances may havequadrilateral shapes with increasing areas. A controller may determinean illumination pattern for a composite camera arrangement field of viewbased on a level of inclusion of a telephoto field of view or awide-angle field of view in the composite field of view. The level ofinclusion may vary in a spectrum from the composite camera arrangementfield of view being primarily based on the wide-angle field of view tothe composite camera arrangement field of view being based primarily onthe telephoto field of view. In some embodiments, a controller may beconfigured to receive information indicating a camera optical zoomlevel, a camera mode, such as a wide-angle mode or a telephoto mode, adigital zoom level, an estimated distance to objects in a scene to becaptured by the camera, or other camera information, such as auto-focusinformation. The information may correspond to a level of inclusion of awide-angle field of view or a telephoto field of view in a compositecamera arrangement field of view that varies. The controller may furtherbe configured to infer the level of inclusion of the wide-angle field ofview or the telephoto field of view in the composite camera field ofview based on the optical or digital zoom level of the camera, thedistance to the scene, and/or the camera mode.

In some embodiments, the illumination field may illuminate objects in ascene in the composite camera arrangement field of view at a particulardistance such that corner portions of the scene, which comprises aquadrilateral cross section passing through the composite cameraarrangement field of view at the particular distance, are illuminated toa substantially similar degree as a center portion of the quadrilateralscene.

For a given image capture operation, the controller may furtherconfigure the illumination pattern based on ambient lighting, depth ofobjects in the scene, reflectivity of objects, illumination sensitivityof the imaging device, and so forth. In some embodiments, the controllermay further be configured to determine an overall illumination intensityfor the array of illumination elements and cause one or moreillumination elements of the array of illumination elements to emitlight according to the determined overall illumination intensity. Insome embodiments, an overall illumination intensity for the array ofillumination elements may be determined based, at least in part, on adistance from a light source module to objects in a scene in a camerafield of view to be illuminated. Also, in some embodiments, an overallillumination intensity for one or more illumination elements may furtherbe determined based, at least in part, on ambient lighting conditionsfor a scene to be illuminated. In some embodiments, an overall amount ofcurrent allocated to the light source module may be limited, and thecontroller for the light source module may strategically distributecurrent to illumination elements of the illumination array such thatsome illumination elements are supplied more current than others. Thecontroller may determine a distribution of current to the illuminationelements of the light source module in a way that optimizes how light isprojected out into the scene, for example to compensate for distance,ambient lighting conditions, reflectivity differences, lens effects,background lighting conditions, etc.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a light source module with adjustable illuminationarray and projection lens, according to some embodiments.

FIG. 2 illustrates a system including a controller that can adjust anillumination array and projection lens, according to some embodiments.

FIG. 3A illustrates a composite camera field of view, according to someembodiments.

FIG. 3B illustrates a camera with a single lens component providingvariable fields of view, according to some embodiments.

FIG. 3C illustrates a light source module with adjustable illuminationarray and projection lens embedded in a mobile computing device,according to some embodiments.

FIGS. 4A-C illustrate a light source module with adjustable illuminationarray and projection lens illuminating scenes at different distances,according to some embodiments.

FIG. 5 is a flow diagram illustrating a method for providing field ofview compensation using an illumination array and projection lens,according to some embodiments.

FIG. 6 is a flow diagram illustrating a method for providing field ofview compensation using an illumination array and an adjustableprojection lens, according to some embodiments.

FIG. 7 is a flow diagram illustrating a method for providing imaginglens shading compensation using an illumination array and a projectionlens, according to some embodiments.

FIG. 8 illustrates an exemplary backlit scene, according to someembodiments.

FIG. 9 is a flow diagram illustrating a method for providing backlightcompensation using an illumination array and a projection lens,according to some embodiments.

FIG. 10 illustrates an exemplary scene including background ambience,according to some embodiments.

FIG. 11 is a flow diagram illustrating a method for providing ambiencepreservation using an illumination array and a projection lens,according to some embodiments.

FIG. 12 illustrates an exemplary scene including an isolated subject,according to some embodiments.

FIG. 13 is a flow diagram illustrating a method for providing minimaldisturbance using an illumination array and a projection lens, accordingto some embodiments.

FIG. 14 illustrates an exemplary scene including objects at differentdepths, according to some embodiments.

FIG. 15 is a flow diagram illustrating a method for providing depthcompensation using an illumination array and a projection lens,according to some embodiments.

FIG. 16 illustrates an exemplary scene with objects of varying ambientillumination, according to some embodiments.

FIG. 17 is a flow diagram illustrating a method for providing ambiencecompensation using an illumination array and a projection lens,according to some embodiments.

FIG. 18 illustrates an exemplary scene including objects of varyingreflectivity, according to some embodiments.

FIG. 19 is a flow diagram illustrating a method for providingreflectivity compensation using an illumination array and a projectionlens, according to some embodiments.

FIG. 20 illustrates an exemplary low light scene, according to someembodiments.

FIG. 21 is a flow diagram illustrating a method for providing low-lightscene illumination using an illumination array and a projection lens,according to some embodiments.

FIG. 22 illustrates an exemplary scene supporting bounce flash,according to some embodiments.

FIG. 23 is a flow diagram illustrating a method for providing indirectflash using an illumination array and a projection lens, according tosome embodiments.

FIG. 24 is a flow diagram illustrating a method for providing creativesupplemental illumination matching artistic intent using an illuminationarray and a projection lens, according to some embodiments.

FIG. 25A illustrates a total internal reflection (TIR) lens that may beincluded in a light source module, according to some embodiments.

FIG. 25B illustrates a reflector that may be included in a light sourcemodule, according to some embodiments.

FIG. 26A-B illustrate a light source module embedded in a mobilecomputing device, according to some embodiments.

FIG. 27 is a flow diagram illustrating a method for enabling aflashlight mode using an illumination array and projection lens,according to some embodiments.

FIG. 28 illustrates a portable multifunction device with an embeddedlight source module, according to some embodiments.

FIG. 29 illustrates an example computer system, according to someembodiments.

This specification includes references to “one embodiment” or “anembodiment.” The appearances of the phrases “in one embodiment” or “inan embodiment” do not necessarily refer to the same embodiment.Particular features, structures, or characteristics may be combined inany suitable manner consistent with this disclosure.

“Comprising.” This term is open-ended. As used in the appended claims,this term does not foreclose additional structure or steps. Consider aclaim that recites: “An apparatus comprising one or more processorunits. . . . ” Such a claim does not foreclose the apparatus fromincluding additional components (e.g., a network interface unit,graphics circuitry, etc.).

“Configured To.” Various units, circuits, or other components may bedescribed or claimed as “configured to” perform a task or tasks. In suchcontexts, “configured to” is used to connote structure by indicatingthat the units/circuits/components include structure (e.g., circuitry)that performs those task or tasks during operation. As such, theunit/circuit/component can be said to be configured to perform the taskeven when the specified unit/circuit/component is not currentlyoperational (e.g., is not on). The units/circuits/components used withthe “configured to” language include hardware—for example, circuits,memory storing program instructions executable to implement theoperation, etc. Reciting that a unit/circuit/component is “configuredto” perform one or more tasks is expressly intended not to invoke 35U.S.C. § 112, sixth paragraph, for that unit/circuit/component.Additionally, “configured to” can include generic structure (e.g.,generic circuitry) that is manipulated by software and/or firmware(e.g., an FPGA or a general-purpose processor executing software) tooperate in manner that is capable of performing the task(s) at issue.“Configure to” may also include adapting a manufacturing process (e.g.,a semiconductor fabrication facility) to fabricate devices (e.g.,integrated circuits) that are adapted to implement or perform one ormore tasks.

“First,” “Second,” etc. As used herein, these terms are used as labelsfor nouns that they precede, and do not imply any type of ordering(e.g., spatial, temporal, logical, etc.). For example, a buffer circuitmay be described herein as performing write operations for “first” and“second” values. The terms “first” and “second” do not necessarily implythat the first value must be written before the second value.

“Based On.” As used herein, this term is used to describe one or morefactors that affect a determination. This term does not forecloseadditional factors that may affect a determination. That is, adetermination may be solely based on those factors or based, at least inpart, on those factors. Consider the phrase “determine A based on B.”While in this case, B is a factor that affects the determination of A,such a phrase does not foreclose the determination of A from also beingbased on C. In other instances, A may be determined based solely on B.

DETAILED DESCRIPTION Introduction

Some embodiments provide a light source module with adjustableillumination array and projection lens such that light emitted from thearray of illumination elements forms a light field of a particularillumination pattern with variable illumination intensities for portionsof the illumination pattern. The light source module may emit a pyramidshaped beam of light with square or rectangular cross-sections and maybe configured to project a light pattern that corresponds to a pyramidshaped composite field of view of one or more cameras associated withthe light source module. The light pattern may have variable lightintensities within the pyramid shaped beam of light such that someportions of a square or rectangular cross-section are more illuminatedthan other portions. A controller for the light source module maydetermine such variable illumination intensities, based on measuredscene conditions, as further discussed herein.

The composite camera field of view may have rectangular or square shapedcross sections at different distances (e.g., scenes) within thecomposite camera field of view. The composite field of view may be acombination of a wide-angle field of view of a wide-angle lens systemand a telephoto field of view of a telephoto lens system. Also, thecomposite field of view may continuously vary over a spectrum fromnearly fully wide-angle to nearly fully telephoto based on a level ofinclusion of the wide-angle field of view or the telephoto field of viewin the composite camera field of view. For example, in some embodiments,a first camera may include a telephoto lens system and a second cameramay include a wide-angle lens system, in such embodiments the first andsecond camera may capture composite images that use some image data fromeach of the two cameras. In such embodiments a composite field of viewof the two cameras may vary based on a level of inclusion of image datafrom each of the two cameras in a composite image. In other embodiments,a common camera may include an aperture associated with a telephoto lenssystem and an aperture associated with a wide-angle lens system and maycombine light or image data from both the wide-angle lens system and thetelephoto lens system to form a composite image. A level of inclusion oflight or image data from the wide-angle lens system or the telephotolens system may be adjustable such that a level of inclusion of atelephoto field of view or a wide-angle field of view in a compositecamera field of view may be adjusted.

Furthermore, the light source module may include or interact with acontroller that is configured to adjust individual elements of anillumination array based, at least in part, on variable levels ofintensity of light to be projected into portions of a scene, adetermined light field pattern to be used to illuminate the scene and awide-angle lens system field of view or a telephoto lens system field ofview used in a composite camera field of view to capture an image of thescene.

In some embodiments, a light source module may include or interact witha controller configured to determine an estimated distance to objects ina camera field of view and adjust individual elements of an illuminationarray based on the distance to the objects in the camera field of viewsuch that light emitted from the light source module substantiallyilluminates the one or more objects in the scene that are within thecamera field of view. For example, when an estimated distance to one ormore objects in a scene in a camera field of view is a shorter distance,a controller may adjust individual elements of an illumination array sothat light is evenly spread across the closer scene in the camera fieldof view.

Some embodiments may include a controller that estimates a distance toan object in a scene in a field of view of a camera based on informationreceived from the camera. For example, a controller may use, zoom levelinformation and/or autofocus information from a camera to estimate adistance to one or more objects in a scene to be captured by the camera.In some embodiments, a controller for a light source module may beincluded with a controller that also controls a camera associated withthe light source module. In some embodiments, a controller for a lightsource module may be separate from a camera controller and may receiveinformation from a camera controller, such as zoom information and/orautofocus information. In some embodiments, a light source module and/ormobile device comprising a light source module may include one or moresensors that directly measure distance, such as a LiDAR sensor, laserand reflected light sensor, or other type of depth sensor.

In some embodiments, a controller for a light source module may alsodetermine an illumination intensity for illumination elements of a lightsource module. For example, a controller for a light source module mayuse an estimated distance to an object in a scene to be captured by thecamera, camera sensor sensitivity settings, such as camera ISO settingsor shutter speeds, and/or ambient lighting conditions to determine anillumination intensity for one or more illumination elements of a lightsource module. For example, under darker light conditions, a camera mayselect a certain ISO setting that corresponds with darker conditions anda controller may select illumination settings for illumination elementsof a light source module that correspond to a higher illuminationintensity to illuminate the darker field of view. The selectedillumination settings may be greater than would be selected for a fieldof view with brighter lighting conditions. In some embodiments, thecontroller may independently determine illumination intensity settingsfor individual ones of an array illumination elements of the lightsource module based on the distance to the object in the scene in thecamera field of view, light conditions of the scene in the camera fieldof view, etc. In some embodiments, different illumination intensitiesfor different illumination elements of the array may be determined basedon different distances to objects in the scene, wherein the differentones of the illumination elements illuminate different portions of thescene comprising the objects at different distances.

Light Source Module with Adjustable Illumination Array and ProjectionLens

FIG. 1 illustrates a light source module with adjustable illuminationarray and projection lens, according to some embodiments. Anillumination module 100 may include an illumination array 110 comprisinga plurality of illumination elements, such as an array of light emittingdiodes (LEDs) or laser diodes. These illumination elements may, in someembodiments, be arranged in a two-dimensional matrix such thatindividual illumination elements correspond to a two-dimensional matrixof zones in an imaging scene.

Light emitted by individual ones of the illumination elements may, insome embodiments, be collectively projected through a shared projectionlens 120 to generate an illumination field 140. The shared projectionlens 120 may be implemented in any number of configurations. Forexample, as shown in FIG. 1 a simple, single element lens may be used.In this example, light emitted by individual ones of the illuminationelements may be inverted, both horizontally and vertically, whenprojected onto the illumination field 140. In other projection lensembodiments, these inversions may not occur and the controller 130 maymaintain a mapping of individual ones of the illumination elements ofthe illumination array 110 to positions in an illumination pattern 150of an illumination field 140 so as to control the specific illuminationpattern 150. In other embodiments, the shared projection lens 120 may bea multi-element lens and individual lenses may be of a conventionalshape or may include alternative shapes such as discussed below in FIG.25A. Furthermore, in some embodiments the lens 120 may be of a fixedtype and in other embodiments may be and adjustable type under thecontrol of controller 130. It should be understood that the aboveexamples are not intended to be limiting and any number of shared lensconfigurations may be used.

In addition, a controller 130 may determine an overall illuminationintensity (not shown), may determine illumination field 140 and maydetermine illumination pattern 150 for the illumination array 110. Insome embodiments, the controller 130 may be implemented in hardware orin software. In some embodiments, controller 130 may be implemented byone or more processors via program instructions stored in a memory of amobile device. In some embodiments, the controller 130 may instruct anillumination element array to illuminate a scene using variableillumination intensities for a particular illumination field andillumination pattern by controlling the individual intensities ofrespective illumination elements within the illumination array 110. Insome embodiments, the controller 130 may additionally instruct anadjustable projection lens to be actuated via an actuator, such as theprojection lens 120, as part of implementing a particular illuminationfield 140 and illumination pattern 150.

Various illumination patterns 150 may be implemented by the controller130. In some embodiments, the controller may implement wide illuminationpatterns to evenly illuminate scenes with a wide field of view. In someembodiments, a wide pattern may be achieved by controlling individualelements of the illumination array 110 to all emit a relatively sameamount of light while in other embodiments an adjustable projection lens120 may be configured to project a wide illumination field 140 byadjusting a position of the projection lens 120 relative to theillumination array 110. In still other embodiments a combination ofcontrol of illumination elements and a projection lens may be employed.In some embodiments, a narrow pattern may be achieved by controllingelements contributing to the center of the illumination field to emitmore light than elements contributing to the periphery of theillumination field, while in other embodiments an adjustable projectionlens 120 may be configured to be adjusted via an actuator to project anarrow illumination field 140. In still other embodiments a combinationof control of illumination elements and adjustment of a projection lensmay be employed. In some embodiments, more complex illumination patterns150 may be employed, as discussed below in FIGS. 4-24 .

In some embodiments, an overall amount of power consumed by anillumination array may be constrained for various reasons includingbattery life and heat dissipation. By varying the illumination producedby individual elements of the illumination array, greater illuminationof objects of interest for a given amount of power may be realized, orin the alternative proper illumination of objects of interest may beprovided at a reduced overall level of power consumed.

FIG. 2 illustrates a system including a controller that is configured toadjust an illumination array and projection lens, according to someembodiments. One or more sensors, such as sensor(s) 200, may detect acondition of a scene to be illuminated by a light source module.Examples of such sensors are camera imaging sensors, depth sensors,focus sensors, and ambient light sensors, in various embodiments. Theseexamples, however, are merely examples and any number of sensorsdetecting various lighting conditions of a scene may be employed and theabove examples are not intended to be limiting.

The sensor(s) communicates with a controller, such as controller 210,and the controller determines an illumination intensity, illuminationfield and illumination pattern for an illumination array based onmeasurements of the scene determined via the sensors. In someembodiments, a controller, such as controller 210, may be implemented inhardware or in software. In some embodiments, controller 210 may beimplemented via program instructions executed on one or more processorsof a mobile device, wherein the program instructions are stored in amemory of the mobile device.

A light source module, such as light source module 220, may comprise anillumination element array 224, such as the illumination array 110 ofFIG. 1 , and projection lens 226, such as the projection lens 120 ofFIG. 1 . In some embodiments, a controller, such as controller 210 mayinstruct an illumination element array to illuminate at a particularoverall illumination intensity with a particular illumination field andillumination pattern by controlling the individual intensities ofrespective illumination elements within the illumination array 224. Insome embodiments, the projection lens, such as the projection lens 226,may be a fixed lens, while in other embodiments the controller 210 mayadditionally instruct an actuator to adjust a position of an adjustableprojection lens as part of implementing a particular illumination fieldand illumination pattern.

Example Mobile Devices Including an Adjustable Light Source Module

FIG. 3A illustrates an example composite field of view that includes acombination of a telephoto field of view and a wide-angle field of view,according to some embodiments. Camera 302 may include a wide-anglecamera and lens system 302 and a telephoto camera and lens system 304.Individual camera and lens systems, such as 302 and 304, may have one ormore characteristic fields of view that are defined by respective focallengths of the system lenses and the two-dimensional size of a camerasensor within the respective camera and lens systems. While not shown,in some embodiments, additional lens systems may be used such as anultra-wide lens system.

In some embodiments, camera systems 302 and 304 may be arranged suchthat the fields of view of the cameras overlap one another. For example,wide angle field of view 306 from camera 302 may overlap with telephotofield of view 308 from camera system 304. Also, in some embodiments,camera systems 302 and 304 may be arranged such that at least a portionof one of the fields of view of the respective cameras does not overlapwith the other camera fields of view. For example, at least a portion ofwide-angle field of view 306 from camera system 302 does not overlapwith telephoto field of view 308 from camera system 304. In someembodiments, a composite field of view may include both the wide-anglefield of view and the telephoto field of view. In some embodiments, acamera arrangement may include other lens systems or additional lenssystems. For example, in some embodiments, one or more intermediate lenssystems between a full telephoto lens system and a full wide-angle lenssystem may be included. Also, in some embodiments, an ultra-wide lenssystem may be included. In regard to a particular image captureoperation or ongoing image capture operation, a controller for a mobiledevice that includes camera 300 may select a level of inclusion forimage data from the wide-angle field of view 306 and the telephoto fieldof view 308 in an image (or video) to be captured by camera 300. Asdescribed above, a light source controller may determine an illuminationintensity with a particular illumination field and illumination patternbased on the level of inclusion of the telephoto field of view or thewide-angle field of view in the composite field of view of the camera300.

FIG. 3B illustrates an example single lens camera that may providevariable fields of view, according to some embodiments. Camera 310 mayinclude a single lens system, that, in various embodiments, may have oneor more characteristic fields of view that are defined by respectivefocal lengths of the lens and the two-dimensional size of a camerasensor (not shown) within the respective camera 310. In someembodiments, the one or more characteristic fields of view may include awide or ultrawide field of view characteristic of wide or ultrawideangle lenses, while in other embodiments the one or more characteristicfields of view may include narrower fields of view such as associatedwith portrait or telephoto lens systems. In various embodiments, anactive two-dimensional area of the camera sensor may be configured toadjust the field of view, where a widest field of view of the camera 310may be obtained by enabling a maximum or entire area of the camerasensor and progressively narrower fields of view may be configured byreducing the active area of the sensor by deactivating or discardingdata from sensor elements along the periphery of the sensor.Furthermore, each of the two dimensions of the sensor may be configuredindependently, allowing for varying aspect ratios as well as fields ofview provided by the camera 310, in some embodiments. Furthermore, Insome embodiments, a controller 312 for the camera sensor configuring thefield of view may be implemented in software or hardware within a devicehosting the camera 310, such as a mobile device 320.

FIG. 3C illustrates mobile device 320 that includes light source module330 and camera 325. Camera 325 may include a first aperture associatedwith a wide-angle lens system and a second aperture associated with atelephoto lens system or may include more than one camera, wherein atleast one of the cameras has an aperture associated with a wide-anglelens system and at least one of the cameras has an aperture associatedwith a telephoto lens system. In some embodiments, additional lenssystems may be included. For example, camera 320 may include wide-anglecamera system 302, telephoto camera system 304, both wide-angle camerasystem 302 and telephoto camera system 304, or a hybrid camera that isconfigured to operate in both a wide-angle and telephoto mode. In someembodiments, a scene in a camera field of view may be adjusted based ona digital zoom. In some embodiments, a camera field of view mayalternatively or additionally be adjusted using an optical zoom.

The light source module 330 may further include an illumination array340, such as the illumination array 110 of FIG. 1 or the illuminationelement array 224 of FIG. 2 , a projection lens 350, such as theprojection lens 120 of FIG. 1 or projection lens 226 of FIG. 2 , etc. Acontroller, not shown, such as the controller 210 of FIG. 2 , maydetermine illumination intensity with a particular illumination fieldand illumination pattern based on camera field of view, user input,and/or data received from sensors such as sensors 200 of FIG. 2 .Examples of such sensors may, in some embodiments, include the camera325.

Light Source Module with Adjustable Field of Illumination

In some embodiments, a light source module may include an adjustableillumination array and projection lens illuminating scenes at differentdistances. In some embodiments, a controller, such as controller 410 asshown in FIG. 4A-4C, may use a level of inclusion of a wide-angle fieldof view of a wide-angle lens system and a level of inclusion of atelephoto field of view of a telephoto lens system in a compositecamera, such as is shown above in FIG. 3A, for a field of view todetermine a level of diffusion for illuminating a scene in the compositecamera field of view. For ease of illustration, a composite using twolens systems is described. However, in some embodiments, a compositecamera may include additional lens systems, such as three or more lenssystems, in some embodiments.

In some embodiments, a level of inclusion of a wide-angle field of viewor a level of inclusion of a telephoto field of view may be inferredfrom camera zoom level information and/or distance information. In someembodiments, a camera may determine an estimated distance to an objectin a camera field of view and a controller for a light source module mayuse the estimated distance determined by the camera to adjust a level ofdiffusion for illumination of a scene. In some embodiments, a controllermay receive camera information from a camera, such as auto-focusinformation, and may determine an estimated distance to an object in ascene in a camera field of view based on the received camerainformation. In some embodiments, a controller may determine anestimated distance to a scene to be captured by a camera based onwhether the camera is operating in a telephoto mode or a wide-anglemode. Also, in some embodiments, a mobile device may include multiplecameras, such that when operating in a telephoto mode a telephoto camerais selected and when operating in a wide-angle mode, a wide-angle camerais selected. In some embodiments a single camera may include two or moreapertures and two or more lens systems, wherein one of the lens systemshas a wider angle than the other lens system(s), such as a telephotolens system. Also, in some embodiments, a mobile device may operate in ahybrid mode that utilizes both a telephoto camera and a wide-anglecamera at the same time. A controller may use any of the above-describedcombinations of wide angle, telephoto, and/or varying degrees ofwide-angle/telephoto composite field of view selections to adjust anillumination array and projection lens system. Additionally, acontroller may measure distance directly, for example via a LiDAR orradar sensor.

Illuminating objects in a quadrilateral scene in a camera field of viewof one or more cameras associated with a light source module such thatthe objects are illuminated evenly in the quadrilateral scene may resultin better images being captured by the associated one or more camerasthan if the quadrilateral scene was illuminated such that the objectsare unevenly illuminated. For example, in FIGS. 4A-4C light sourcemodule 402 has a rectangular (quadrilateral) output pattern 424 and 434.A rectangular output pattern of a light source module may be designed tomatch a rectangular (quadrilateral) scene in a camera field of view ofan associated one or more cameras. Thus, the light source module may beconfigured to project light in a pyramid shaped pattern matching the oneor more camera's field of view with rectangular cross-sections atvarious distances from the one or more cameras. However, at varyingwidth camera fields of view different levels illumination may berequired from individual elements if the illumination array to evenlyilluminate objects in a camera field of view while maintaining arectangular illumination pattern of a scene at a given distance withinthe camera field of view.

As shown in FIG. 4A, camera 420 is primarily in an ultrawide-anglecamera selection and controller 410 may adjust light source illuminationmodule 400 output to an ultrawide pattern output level based on thelevel of inclusion of the ultrawide-angle field of view and/or anestimated distance 423 to scene 422 in a composite field of view. Thisultrawide pattern may be achieved by controlling individual elements 402to all emit a relatively same amount of light as discussed above in FIG.1 . Adjusting controller 410 to the ultrawide pattern output levelcauses light emitted from illumination elements 402 to evenly illuminatescene 424 in an illumination field of the light source module, whereinscene 424 has a quadrilateral shape matching scene 422 in the compositefield of view. For clarity, scene 422 in the composite field of view andscene 424 in the illumination field are shown in FIG. 4A as adjacent toeach other. However, in operation, scene 424 in the illumination fieldand scene 422 in the composite field of view may be on top of eachother, e.g., camera 420 may be taking a picture of the same scene thatis being illuminated by light source module 400.

As shown in FIG. 4B, camera 430 is primarily in a wide camera selectionand controller 410 may adjust light source illumination module 400output to a wide pattern output level providing a more focused patternto reach scene 434 in the illumination field that is at a furtherdistance 433. This wide pattern may be achieved by controllingindividual elements 402 such that elements contributing to the center ofthe illumination field emit more light that elements contributing to theperiphery of the illumination field, as discussed above in FIG. 1 .Adjusting controller 410 to the wide pattern output level causes lightemitted from illumination elements 402 to evenly illuminate scene 434 inan illumination field of the light source module, wherein scene 434 hasa quadrilateral shape matching scene 432 in the composite field of view.As discussed above, scene 434 in the illumination field and scene 432 inthe composite field of view are illustrated as being adjacent to oneanother in FIG. 4B. However, in operation scene 434 and scene 432 may beon top of each other or represent the same scene.

As shown in FIG. 4C, camera 440 is primarily in a telephoto cameraselection and controller 410 may adjust light source illumination module400 output to a narrow or telephoto pattern output level providing amore focused pattern to reach scene 444 in the illumination field thatis at a further distance 443. This narrow pattern may be achieved bycontrolling individual elements 402 such that elements contributing tothe center of the illumination field emit more light that elementscontributing to the periphery of the illumination field, as discussedabove in FIG. 1 . Adjusting controller 410 to the telephoto or narrowpattern output level may cause light emitted from illumination elements402 to evenly illuminate scene 444 in an illumination field of the lightsource module, wherein scene 444 has a quadrilateral shape matchingscene 442 in the composite field of view. As discussed above, scene 444in the illumination field and scene 442 in the composite field of vieware illustrated as being adjacent to one another in FIG. 4C. However, inoperation scene 444 and scene 442 may be on top of each other orrepresent the same scene.

FIG. 5 is a flow diagram illustrating a method for providing field ofview compensation using an illumination array and projection lens,according to some embodiments. The method begins at step 500 where,during the capture of an image, a configured field of view for animaging device may be determined. This determination may be performed ina number of ways, as discussed above in FIGS. 3 and 4 .

Once the configured field of view for the imaging device has beendetermined, the method may proceed to step 510 where a controller, suchas the controller 130 of FIG. 1 , may determine a field of illuminationthat is narrowed to match the determined field of view for the imagingdevice, in some embodiments. To accomplish this, the controller maydiminish, or disable, individual elements of an illumination array thatcontribute to a periphery of an illumination field outside thedetermined field of view for the imaging device to narrow the field ofillumination to match the determined field of view for the imagingdevice, in some embodiments.

Once the field of illumination has been established, the method proceedsto step 520 where individual elements of an illumination array, such asthe illumination array 110, may be configured to provide an illuminationpattern, such as the illumination pattern 150 of FIG. 1 , that providesthe narrowed illumination field, such as the illumination field 140 ofFIG. 1 , matching the determined field of view for the imaging device.In addition, elements of the illumination array contributing toillumination of the field of view of the imaging device may be scaled(e.g., by varying current supplied to the illumination elements) toprovide a target illumination value for the image capture.

The method may then proceed to step 530 where a scene may be illuminatedaccording to the determined illumination pattern, in some embodiments.

FIG. 6 is a flow diagram illustrating a method for providing field ofview compensation using an illumination array and an adjustableprojection lens, according to some embodiments. The method begins atstep 600 where, during the capture of an image, a configured field ofview for an imaging device may be determined. This determination may beperformed in a number of ways, as discussed above in FIGS. 3 and 4 .

Once the configured field of view for the imaging device has beendetermined, the method may proceed to step 610 where a controller, suchas the controller 130 of FIG. 1 , may determine a field of illuminationand illumination pattern that is narrowed to match the determined fieldof view for the imaging device, in some embodiments.

Once the field of illumination and illumination pattern have beenestablished, the method proceeds to step 620 where an adjustableprojection lens and individual elements of an illumination array, suchas the illumination array 110, may be configured to provide the field ofillumination, such as the field of illumination 140 of FIG. 1 , andillumination pattern, such as the illumination pattern 150 of FIG. 1 ,in some embodiments. To accomplish this, the controller may adjust aposition of the projection lens via an actuator to provide thedetermined field of illumination and may diminish, or disable,individual elements of an illumination array that contribute to aperiphery of the illumination field outside the determined field of viewfor the imaging device to narrow the field of illumination to match thedetermined field of view for the imaging device, in some embodiments. Inaddition, elements of the illumination array contributing toillumination of the field of view of the imaging device may be scaled(e.g., by varying an amount of current supplied to the illuminationelements) to provide a target illumination value for the image capture.

The method may then proceed to step 630 where a scene may be illuminatedaccording to the determined illumination pattern, in some embodiments.

Example Method for Providing Lens Shading Compensation

FIG. 7 is a flow diagram illustrating a method for providing imaginglens shading compensation using an illumination array and a projectionlens, according to some embodiments. The method begins at step 700where, during the capture of an image, a configured field of view for animaging device may be determined. This determination may be performed ina number of ways, as discussed above in FIGS. 3 and 4 .

The imaging device may include an imaging lens that projects an image tobe captured onto an imaging sensor. This imaging lens may have acharacteristic focal length, where in some embodiments this focal lengthmay be fixed while in other embodiments the focal length may beconfigurable. In still other embodiments, the focal length may vary overthe focusing range of the lens.

The imaging sensor may have a characteristic size and, in someembodiments, a configurable active size, with the field of view of theimaging device determined by the characteristic focal length, asconfigured, of the imaging lens and the characteristic size or activesize of the imaging sensor. In addition, illumination of the imagingsensor by the imaging lens may vary over the surface of the imagingsensor for a variety of reasons including lens shading and vignetting,resulting in variations of illumination sensitivity over the surface ofthe imagine sensor such as, for example, light falloff at the peripheryof the image sensor giving the appearance of a darken border of theresulting image. Lens shading and vignetting, however, are merelyexamples of variations in illumination sensitivity; these examples arenot intended to be limiting and any number of causes and effects may beimaged.

This image projected by the imaging lens onto the imaging sensor may becharacterized using an illumination sensitivity model for the imagingdevice, the illumination sensitivity model describing variations ofillumination sensitivity over the surface of the imagine sensor. Oncethe configured field of view for the imaging device has been determined,the method may proceed to step 710 where a profile containing thisillumination sensitivity model may be obtained by a controller, such asthe controller 130 of FIG. 1 , in some embodiments. This profile may beobtained in a variety of ways similar to the manner in which the fieldof view is determined, as discussed above in FIGS. 3 and 4 . In someembodiments, the illumination sensitivity model of the profile may beobtained from a lookup table associated with the field of view of theimaging device. For example, known lens shading effects may be stored inthe lookup table for the particular camera configuration. This, however,is merely one example and is not intended to be limiting.

Once the illumination sensitivity model has been obtained, the methodmay proceed to step 720 where a controller, such as the controller 130of FIG. 1 , may configure an illumination pattern to compensate for theillumination sensitivity model of imaging device, in some embodiments.To accomplish this, the controller may adjust individual elements of anillumination array, where elements that contribute to portions of thescene with lower illumination sensitivity are configured to emit morelight than elements that contribute to portions of the scene with higherillumination sensitivity, in some embodiments.

In some embodiments, a projection lens may be adjustable to control thefield of illumination, such as discussed above in FIGS. 1, 2 and 6 . Inthese embodiments, the controller may also adjust the adjustableprojection lens to provide a field of illumination in combination withconfiguring the illumination pattern to compensate for the illuminationsensitivity model of imaging device, in these embodiments.

Once the illumination pattern has been configured to compensate for theillumination sensitivity model of imaging device, the method may proceedto step 730 where an overall level of illumination for the array may bedetermined and elements of the illumination array contributing toillumination of the field of view of the imaging device may be scaled toprovide an overall illumination value for the image capture.

The method may then proceed to step 740 where a scene may be illuminatedaccording to the determined illumination pattern, in some embodiments.In some embodiments, such a method to compensate for lens shading and/orthe illumination sensitivity model may be combined with various otherones of the methods described herein.

Example Method for Providing Backlight Compensation

FIG. 9 is a flow diagram illustrating a method for providing backlightcompensation using an illumination array and a projection lens,according to some embodiments. As shown in FIG. 8 , an exemplary backlitscene may include a foreground object, or subject, 800 and a backgroundregion 810.

The method begins at step 900 where, during the capture of an image, aforeground object, such as the foreground object 800 of FIG. 8 , and abackground region, such as the background region 810 of FIG. 8 , withinthe field of view of an imaging device may be determined. Thisdetermination may be performed in a number of ways. For example,sensors, such as sensor(s) 200 as shown in FIG. 2 , may be employed tolocate various regions and objects within a scene. This example,however, is not intended to be limiting and various methods ofdetermining such objects and regions may be employed.

Once the foreground object and background region have been determined,the method may proceed to step 910 where ambient illumination values forthe foreground object and background region may be determined. Thisdetermination may be performed in a number of ways. For example,sensors, such as sensor(s) 200 as shown in FIG. 2 , may be employed todetermine ambient illumination values within a scene. This example,however, is not intended to be limiting and other methods may beemployed.

Once the ambient illumination values have been determined, the methodmay proceed to step 920 where a set of elements of an illumination arraymay be identified that emit light that contribute to illumination of theforeground object, in some embodiments. Once identified, as shown instep 930, a controller, such as the controller 130 of FIG. 1 , mayconfigure an illumination pattern, such as the illumination pattern 150of FIG. 1 , such that the identified set of elements emits light tobalance the illumination of the foreground object according to theambient illumination values of the foreground object and backgroundregion.

Once the illumination pattern has been configured, the method may thenproceed to step 940 where a scene may be illuminated according to thedetermined illumination pattern, in some embodiments.

Example Method for Providing Ambience Preservation

FIG. 11 is a flow diagram illustrating a method for providing ambiencepreservation using an illumination array and a projection lens,according to some embodiments. As shown in FIG. 10 , an exemplaryambience preservation scene may include a foreground object, or subject,1000 and a background region 1010.

The method begins at step 1100 where, during the capture of an image, aforeground object, such as the foreground object 1000 of FIG. 10 , and abackground region, such as the background region 1010 of FIG. 10 ,within the field of view of an imaging device may be determined. Thisdetermination may be performed in a number of ways. For example,sensors, such as sensor(s) 200 as shown in FIG. 2 , may be employed tolocate various regions and objects within a scene. This example,however, is not intended to be limiting and various methods ofdetermining such objects and regions may be employed.

Once the foreground object and background region have been determined,the method may proceed to step 1110 where ambient illumination valuesfor the foreground object and background region may be determined. Thisdetermination may be performed in a number of ways. For example,sensors, such as sensor(s) 200 as shown in FIG. 2 , may be employed todetermine ambient illumination values within a scene. This example,however, is not intended to be limiting and other methods may beemployed.

Once the ambient illumination values have been determined, the methodmay proceed to step 1120 where a set of elements of an illuminationarray may be identified that emit light that contribute to illuminationof the foreground object, in some embodiments. In addition, another setof elements of an illumination array may be identified that emit lightthat contribute to illumination of the background region, in someembodiments.

Once identified, as shown in step 1130, a controller, such as thecontroller 130 of FIG. 1 , may configure an illumination pattern, suchas the illumination pattern 150 of FIG. 1 , such that the identified setof elements emits light to balance the illumination of the foregroundobject according to the ambient illumination values of the foregroundobject and background region. In addition, the identified other set ofelements are disabled such that the background region is not illuminatedby the other set of illumination elements, thus preserving the ambientillumination of the background region, in some embodiments.

Once the illumination pattern has been configured, the method may thenproceed to step 1140 where a scene may be illuminated according to thedetermined illumination pattern, in some embodiments.

Example Method for Providing Minimal Disturbance Using Flash

FIG. 13 is a flow diagram illustrating a method for providing minimaldisturbance using an illumination array and a projection lens, accordingto some embodiments. As shown in FIG. 12 , an exemplary scene mayinclude a foreground object, or subject, 1200 and a background region1210.

The method begins at step 1300 where, during the capture of an image, aforeground object, such as the foreground object 1200 of FIG. 12 , and abackground region, such as the background region 1210 of FIG. 12 ,within the field of view of an imaging device may be determined. Thisdetermination may be performed in a number of ways. For example,sensors, such as sensor(s) 200 as shown in FIG. 2 , may be employed tolocate various regions and objects within a scene. This example,however, is not intended to be limiting and various methods ofdetermining such objects and regions may be employed.

Once the foreground object and background region have been determined,the method may proceed to step 1310 where a set of elements of anillumination array may be identified that emit light that contribute toillumination of the foreground object, in some embodiments.

Once identified, as shown in step 1320, a controller, such as thecontroller 130 of FIG. 1 , may configure an illumination pattern, suchas the illumination pattern 150 of FIG. 1 , such that the identified setof elements emits light to illuminate the foreground object. Inaddition, the remaining elements of the illumination array arediminished or disabled such that disturbance of the surroundingenvironment due to illumination by the illumination array is minimized,in some embodiments.

Once the illumination pattern has been configured, the method may thenproceed to step 1330 where a scene may be illuminated according to thedetermined illumination pattern, in some embodiments.

Example Method for Providing Depth Compensation

FIG. 15 is a flow diagram illustrating a method for providing depthcompensation using an illumination array and a projection lens,according to some embodiments. As shown in FIG. 14 , an exemplary scenemay include objects, or subjects, 1440 and 1450 at respective distances1445 and 1445 from an imaging device 1410 with a field of view 1420.

The method begins at step 1500 where, during the capture of an image,multiple objects, such as the objects 1440 and 1450 of FIG. 14 , and abackground region within the field of view, such as the field of view1420 of FIG. 14 , of an imaging device such as the imaging device 1410of FIG. 14 may be determined. This determination may be performed in anumber of ways. For example, sensors, such as sensor(s) 200 as shown inFIG. 2 , may be employed to locate various regions and objects within ascene. This example, however, is not intended to be limiting and variousmethods of determining such objects and regions may be employed.

Once the objects and background region have been determined, the methodmay proceed to step 1510 where respective distances from the imagingdevice, such as distances 1445 and 1445 of FIG. 14 , may be determined,in some embodiments. This determination may be performed in a number ofways. For example, sensors, such as sensor(s) 200 as shown in FIG. 2 ,may be employed to measure object distances within a scene. Thisexample, however, is not intended to be limiting and other methods maybe employed.

Once the respective distances have been determined, the method mayproceed to step 1520 where respective set of elements of an illuminationarray may be identified that emit light that contribute to illuminationof the respective objects, in some embodiments.

Once the respective sets of elements are identified, as shown in step1530, a controller, such as the controller 130 of FIG. 1 , may configurean illumination pattern, such as the illumination pattern 150 of FIG. 1, such that the identified sets of elements emit light to illuminate theobjects according to their respective distances and an ambientillumination value determined for the identified background region, insome embodiments.

Once the illumination pattern has been configured, the method may thenproceed to step 1530 where a scene may be illuminated according to thedetermined illumination pattern, in some embodiments.

Example Method for Providing Ambience Compensation

FIG. 17 is a flow diagram illustrating a method for providing ambiencecompensation using an illumination array and a projection lens,according to some embodiments. As shown in FIG. 16 , an exemplary scenemay include objects, or subjects, 1600 and 1610.

The method begins at step 1700 where, during the capture of an image,multiple objects, such as the objects 1600 and 1610 of FIG. 16 withinthe field of view of an imaging device may be determined. Thisdetermination may be performed in a number of ways. For example,sensors, such as sensor(s) 200 as shown in FIG. 2 , may be employed tolocate various regions and objects within a scene. This example,however, is not intended to be limiting and various methods ofdetermining such objects and regions may be employed.

Once the objects have been determined, the method may proceed to step1710 where ambient illumination values for the objects may bedetermined. This determination may be performed in a number of ways. Forexample, sensors, such as sensor(s) 200 as shown in FIG. 2 , may beemployed to determine ambient illumination values within a scene. Thisexample, however, is not intended to be limiting and other methods maybe employed.

Once the ambient illumination values have been determined, the methodmay proceed to step 1720 where respective set of elements of anillumination array may be identified that emit light that contribute toillumination of the respective objects, in some embodiments.

Once the respective sets of elements are identified, as shown in step1730, a controller, such as the controller 130 of FIG. 1 , may configurean illumination pattern, such as the illumination pattern 150 of FIG. 1, such that the identified sets of elements emit light to illuminate theobjects to balance the illumination of the respective objects with theillumination of the other objects, in some embodiments.

Once the illumination pattern has been configured, the method may thenproceed to step 1730 where a scene may be illuminated according to thedetermined illumination pattern, in some embodiments.

Example Method for Providing Reflectivity Compensation

FIG. 19 is a flow diagram illustrating a method for providingreflectivity compensation using an illumination array and a projectionlens, according to some embodiments. As shown in FIG. 18 , an exemplaryscene may include objects, or subjects, 1800 and 1810.

The method begins at step 1900 where, during the capture of an image,multiple objects, such as the objects 1800 and 1810 of FIG. 18 withinthe field of view of an imaging device may be determined. Thisdetermination may be performed in a number of ways. For example,sensors, such as sensor(s) 200 as shown in FIG. 2 , may be employed tolocate various regions and objects within a scene. This example,however, is not intended to be limiting and various methods ofdetermining such objects and regions may be employed.

Once the objects have been determined, the method may proceed to step1910 where respective reflectivity values for the objects may bedetermined. This determination may be performed in a number of ways. Forexample, sensors, such as sensor(s) 200 as shown in FIG. 2 , combinedwith light emitted by an illumination array, such as the illuminationelement array 224 of FIG. 2 , may be employed to determine reflectivityvalues within a scene. This example, however, is not intended to belimiting and other methods may be employed.

Once the respective reflectivity values have been determined, the methodmay proceed to step 1920 where respective set of elements of anillumination array may be identified that emit light that contribute toillumination of the respective objects, in some embodiments.

Once the respective sets of elements are identified, as shown in step1930, a controller, such as the controller 130 of FIG. 1 , may configurean illumination pattern, such as the illumination pattern 150 of FIG. 1, such that the identified sets of elements emit amounts of light toilluminate the objects to compensate for reflectivity differencesbetween the objects, in some embodiments.

Once the illumination pattern has been configured, the method may thenproceed to step 1930 where a scene may be illuminated according to thedetermined illumination pattern, in some embodiments.

Example Method for Providing Low Light Scene Illumination

FIG. 21 is a flow diagram illustrating a method for providing low-lightscene illumination using an illumination array and a projection lens,according to some embodiments. As shown in FIG. 20 , an exemplary scenemay include a foreground object, or subject, 2000 and a backgroundobject 2010.

The method begins at step 2100 where, during the capture of an image, aforeground object, such as the foreground object 2000 of FIG. 20 , and abackground object, such as the background object 2010 of FIG. 20 ,within the field of view of an imaging device may be determined. Thisdetermination may be performed in a number of ways. For example,sensors, such as sensor(s) 200 as shown in FIG. 2 , may be employed tolocate various regions and objects within a scene. This example,however, is not intended to be limiting and various methods ofdetermining such objects and regions may be employed.

Once the objects have been determined, the method may proceed to step2110 where a reference brightness value for the background and objectand a target brightness and distance from the imaging device for theforeground object may be determined. These determinations may beperformed in a number of ways. For example, sensors, such as sensor(s)200 as shown in FIG. 2 may be employed to determine brightness valuesand distances within a scene. This example, however, is not intended tobe limiting and other methods may be employed.

Once the brightness and distance values have been determined, the methodmay proceed to step 2120 where respective set of elements of anillumination array may be identified that emit light that contribute toillumination of the respective objects, in some embodiments.

Once the respective sets of elements are identified, as shown in step2130, a controller, such as the controller 130 of FIG. 1 , may configurean illumination pattern, such as the illumination pattern 150 of FIG. 1, such that the set of elements that emits light to illuminate theforeground object is configured according to the reference brightness,the target brightness and the distance from the imaging device, in someembodiments.

Once the illumination pattern has been configured, the method may thenproceed to step 2140 where a scene may be illuminated according to thedetermined illumination pattern, in some embodiments.

Example Method for Providing Indirect Illumination

FIG. 23 is a flow diagram illustrating a method for providing indirectflash using an illumination array and a projection lens, according tosome embodiments. As shown in FIG. 22 , an exemplary scene may include aforeground object, or subject, 2240 at respective distance 2245 from animaging device 2210 with a field of view 2220. In addition, the scenemay include a reflective object 2250 at respective distance 2255 from animaging device 2210.

The method begins at step 2300 where, during the capture of an image, aforeground object, such as the foreground object 2240 of FIG. 22 , and areflective object, such as the reflective object 2250 of FIG. 22 , maybe determined. While the foreground object may be within the field ofview of the image, it should be noted that the reflective may lie withinthe field of view of the image or may lie outside the field of view ofthe image. However, in various embodiments the reflective object may liewithin an illumination field of a light source module.

This determination may be performed in a number of ways. For example,sensors, such as sensor(s) 200 as shown in FIG. 2 , may be employed tolocate various regions and objects within a scene. This example,however, is not intended to be limiting and other methods may beemployed.

Once the objects have been determined, the method may proceed to step2310 where an orientation of the reflective object may be determined, insome embodiments, with respect to the image device, the light sourcemodule and the foreground object. This determination may be performed ina number of ways. For example, sensors, such as sensor(s) 200 as shownin FIG. 2 , combined with light emitted by an illumination array, suchas the illumination element array 224 of FIG. 2 , may be employed todetermine the orientation of the reflective object. This example,however, is not intended to be limiting and other methods may beemployed.

Once the orientation has been determined, the method may proceed to step2320 where respective set of elements of an illumination array may beidentified that emit light that contribute to illumination of theforeground object, including a set of elements that emits light thatdirectly illuminates the foreground object and a set of elements thatemits light that indirectly illuminates the foreground object viareflection off of the reflective object, in some embodiments.

Once the respective sets of elements are identified, as shown in step2330, a desired ratio of direct and indirect lighting for the foregroundobject may be determined. This determination may be performed in anumber of ways. For example, the ratio may be determined from a selectedprofile, from user input through a user interface, of from aconfiguration default. This example, however, is not intended to belimiting and other methods may be employed.

Once the desired ratio has been determined, as shown in step 2340, acontroller, such as the controller 130 of FIG. 1 , may configure anillumination pattern, such as the illumination pattern 150 of FIG. 1 ,such that the respective sets of elements that emit light to illuminatethe foreground object are configured according to the desired ratio, insome embodiments. Once configured, the set of elements that emit lightdirectly illuminating the foreground object will be configured inproportion to the set of elements that emit light directly illuminatingthe foreground object, the proportion based at least in part on thedetermined desired ratio.

Once the illumination pattern has been configured, the method may thenproceed to step 2350 where a scene may be illuminated according to thedetermined illumination pattern, in some embodiments.

Supplemental Illumination Matching Artistic Intent

FIG. 24 is a flow diagram illustrating a method for providing creativesupplemental illumination matching artistic intent using an illuminationarray and a projection lens, according to some embodiments. The methodbegins at step 2400 where, during the capture of an image, a lightingdistribution model may be determined according to artistic content. Thisdetermination may be made in a variety of ways in various embodiments.For example, in some embodiments the lighting distribution model may beselected from a number of preconfigured lighting distribution models.Examples of such preconfigured lighting distribution models may includelighting models that provide lighting patterns over the captured imageto create areas of greater or lesser illumination, contrast, color etc.,for example as in Vermeer lighting or Hollywood lighting techniques.Another example of a preconfigured lighting distribution model may be anillumination pattern that creates a lighting intensity or colorgradient, or that serves to increase contrast or perception of depth inthe image. Still other examples may include lighting patterns intendedto involve emotional responses in viewers of the image. Additionally, insome preconfigured lighting distribution model, objects identified inthe field of view of the image may received preconfigured differentillumination, for example providing focus lighting on identified objectsin the image. In some embodiments, a lighting distribution model may bedetermined based on previously captured images, for example to duplicateor compliment illumination found in previously selected or associatedimages. These various examples are not intended to be limiting, and anynumber of lighting distribution models may be envisioned.

The method may then proceed to 2410 where, based on the determinedmodel, foreground objects, if identified in the determined model, may bedetermined. This determination may be performed in a number of ways. Forexample, sensors, such as sensor(s) 200 as shown in FIG. 2 , may beemployed to locate various regions and objects within a scene. Thisexample, however, is not intended to be limiting and other methods maybe employed.

Once the lighting distribution model and associated object aredetermined and identified, as shown in step 2420, a controller, such asthe controller 130 of FIG. 1 , may configure an illumination pattern,such as the illumination pattern 150 of FIG. 1 , to provide illuminationof the scene to be captured according to the artistic intent. Once theillumination pattern has been configured, the method may then proceed tostep 2430 where the scene may be illuminated according to the determinedillumination pattern, in some embodiments.

Example Lens and Reflectors

In some embodiments, a light source module may include a total internalreflective (TIR) lens and/or a reflector. A TIR lens may be configuredto reflect light such that the light is directed in a particulardirection. For example, as opposed to a non-TIR light source thatgenerates light that leaves the light source spread across 360 degreesor 180 degrees, a TIR lens may concentrate the light into a concentratedbeam in a particular direction. In some embodiments, a TIR lens may beincluded in a light source module between an illumination element and anadjustable light diffusing material. The adjustable light diffusingmaterial may diffuse the concentrated light exiting the TIR lens.However, for illuminating scenes at far distances an adjustable lightdiffusing material may apply minimal diffusion and the concentrated beamof light from the TIR lens may travel to the farther away scene andilluminate the farther away scene to a greater degree thannon-concentrated light from a light source that does not include a TIRlens. Thus, a light source module with both a TIR lens and an adjustablelight diffusing material may be configured to provide diffuse light toilluminate close-up to mid-range scenes and may provide a concentratedlight beam to reach far away scenes.

FIG. 25A illustrates an example TIR lens. Lens 2502 receives light fromillumination element 2504 and provides a concentrated light beam 2506.As can be seen in the cut-out diagram, lens 2502 includes grooves 2508that are angled such that light 2510 from illumination element 2504 passthrough a portion of lens 2502 and are reflected off of grooves 2508such that the reflected light is parallel to other light reflected offof other portions of grooves 2508. Thus, whereas light 2510 fromillumination element 2504 was originally directed in multipledirections, light 2506 exiting lens 2502 is concentrated and generallydirected in the same direction.

FIG. 25B illustrates an example reflector. The reflector includes areflector body 2552 that has a curved shape that is designed such thatlight 2554 from illumination element 2550 is reflected off of thereflector body such that the reflected light is parallel to other lightreflected off of the reflector body. This results in a concentratedlight beam 2556 leaving reflector body 2552.

In some embodiments, a light source module may include both a TIR lensand a reflector, such as the reflector described in FIG. 25B.Furthermore, an adjustable light diffusing material may be placed in aposition adjacent to a TIR lens such that light leaving the TIR lenspasses through the adjustable light diffusing material before exitingthe light source module.

Additional Uses of a Light Source Module

In addition to illuminating a scene to be captured by a camera or videorecorder, a light source module may be used as a flashlight, as anindicator to send visual notifications to users, as an emitter totransmit information via modulated light signals, or for other uses.When being used as a flashlight, an adjustable light diffusing materialmay be used to adjust a beam of light emitted from a light sourcemodule. For example, a user of a mobile device with an embedded lightsource module may desire to have a wide beam of light when searchingthrough an area and may desire to have a focused beam of light whenworking in a fixed location. A light source module, such as any of lightsource modules described above may be used to adjust a beam of lightwhen used in a flashlight mode. In some embodiments, an adjustable lightdiffusing material may be used in a flash light mode to adjust a beam oflight from a light source module between a wide beam and a concentratedor narrow beam.

In some embodiments, a controller of a mobile device may interact withone or more other components of a mobile device to determine whether alight source module in a flash light mode should emit a wide beam oflight or a concentrated or narrow beam of light. For example, acontroller may interact with signals from one or more gyroscopes,accelerometers or other motion detecting devices to determine if amobile device is scanning a wide area or is relatively still and focusedon a single location. In response to determining that a mobile device isfocused on a single location, a controller may switch from a wide beammode to a narrow or concentrated light beam mode. In some embodiments, acontroller may interact with a camera of a mobile device to detectobjects in a scene and focus a light beam on one or more of the objectsdetected in the scene. For example, FIGS. 26A-B illustrates a lightsource module embedded in a mobile device in a flashlight mode. In FIG.26A light source module 2600 is in a flashlight mode and in a narrow orconcentrated beam mode. Light source module 2600 emits a narrow beam oflight 2602. In FIG. 26B light source module 2604 is embedded in a mobiledevice and is in a flashlight mode and in a wide beam mode. Light sourcemodule 2604 emits a wide beam of light 2606. In some embodiments, lightsource modules may be embedded in a variety of devices including mobilecomputing devices such as phones, tablets, etc. and may be used in aflash light mode as described above.

FIG. 27 is a flow diagram illustrating a method for enabling aflashlight mode using an illumination array and projection lens,according to some embodiments. The method begins at step 2700 where acontroller, such as the controller 130 in FIG. 1 , receives a request toenable an illumination array, such as the illumination array 110 in FIG.1 , in a flashlight mode, where the request includes a targetillumination field, such as the illumination field 140 of FIG. 1 , insome embodiments.

Responsive to the request, the controller, as shown in 2710, may thenconfigure an illumination pattern, such as the illumination pattern 150of FIG. 1 , for the illumination array according to the targetillumination field specified in the request, in some embodiments.

Once the illumination pattern has been configured, the method may thenproceed to step 2720 where the illumination array may be enabledaccording to the determined illumination pattern, in some embodiments.

The following clauses describe example embodiments consistent with thedrawings and the above description.

1. A mobile computing device, comprising:

-   -   a camera arrangement comprising:        -   an image capture device;        -   a plurality of illumination elements configured to emit            light;        -   a plurality of background illumination control schemes; and        -   a controller for the plurality of illumination elements,            wherein during capture of an image by an image capture            device, the controller is configured to:            -   identify, within a field of view of the image capture                device, a foreground object and a background region                different from the foreground object;            -   determine an illumination pattern for the light source                module based, at least in part, on:                -   a distance of the foreground object to the image                    capture device;                -   an ambient brightness level of the foreground                    object;                -   an ambient brightness level of the background                    region; and                -   a selected background illumination control scheme of                    the plurality of background illumination control                    schemes; and            -   cause individual ones of the plurality of illumination                elements to respectively emit light to generate the                determined illumination pattern, wherein the individual                ones of the plurality of illumination elements are                respectively configured to emit different amounts of                light based, at least in part, on the distance of the                subject to the image capture device, the ambient                brightness level of the subject and the ambient                brightness level of the background region.

2. The mobile computing device of clause 1, wherein:

-   -   the selected background illumination control scheme is a        background preserving control scheme; and    -   the illumination pattern for the light source module is        configured to:        -   maintain the brightness of the background region at the            ambient brightness level of the background region; and        -   increase the brightness of the foreground object over the            ambient brightness level of the foreground object.

3. The mobile computing device of clause 1, wherein:

-   -   the selected background illumination control scheme is a        background preserving control scheme; and    -   the illumination pattern for the light source module is        configured to:        -   maintain the brightness of the background region at the            ambient brightness level of the background region; and        -   increase the brightness of the foreground object over the            ambient brightness level of the foreground object.

4. The mobile computing device of clause 3, wherein:

-   -   the controller is further configured to identify respective        distances of the plurality of background objects; and    -   the illumination pattern for the light source module is        determined based, at least in part, on the respective distances        of the plurality of background objects to the image capture        device.

5. The mobile computing device of clause 3, wherein:

-   -   the controller is further configured to identify respective        reflectivity values of the plurality of background objects; and    -   the illumination pattern for the light source module is        determined based, at least in part, on the respective        reflectivity values of the plurality of background objects.

6. The mobile computing device of clause 1, wherein:

-   -   the controller is further configured to identify respective        distances of one or more additional foreground objects within        the field of view of the image capture device; and    -   the illumination pattern for the light source module is        determined based, at least in part, on the respective distances        of one or more additional foreground objects.

7. The mobile computing device of clause 1, wherein:

-   -   the image capture device comprises an imaging sensor and an        imaging lens configured to provide a plurality of focal lengths;    -   the light source module further comprises an adjustable lens        configured to project the emitted light of the plurality of        illumination elements; and    -   during the capture of the image by the image capture device, the        controller is further configured to:        -   determine a field of illumination based, at least in part,            on a configured focal length of the imaging lens and a size            of the imaging sensor; and        -   adjust the adjustable lens to the determined field of            illumination.

8. A light source module, comprising:

-   -   a plurality of illumination elements configured to emit light;    -   a plurality of background illumination control schemes; and    -   a controller for the plurality of illumination elements, wherein        during capture of an image by an image capture device, the        controller is configured to:        -   identify, within a field of view of the image capture            device, a foreground object and a background region            different from the foreground object;        -   determine an illumination pattern for the light source            module based, at least in part, on:            -   a distance of the foreground object to the image capture                device;            -   an ambient brightness level of the foreground object;            -   an ambient brightness level of the background region;                and            -   a selected background illumination control scheme of the                plurality of background illumination control schemes;                and        -   cause individual ones of the plurality of illumination            elements to respectively emit light to generate the            determined illumination pattern, wherein the individual ones            of the plurality of illumination elements are respectively            configured to emit different amounts of light based, at            least in part, on the distance of the subject to the image            capture device, the ambient brightness level of the subject            and the ambient brightness level of the background region.

9. The light source module of clause 8, wherein:

-   -   the selected background illumination control scheme is a        background preserving control scheme; and    -   the illumination pattern for the light source module is        configured to:        -   maintain the brightness of the background region at the            ambient brightness level of the background region; and        -   increase the brightness of the foreground object over the            ambient brightness level of the foreground object.

10. The light source module of clause 8, wherein:

-   -   the selected background illumination control scheme is a        background compensating control scheme;    -   the controller is further configured to identify respective        ambient brightness levels of a plurality of background objects        in the background region; and    -   the illumination pattern for the light source module is        configured to:        -   provide differing illumination to the foreground object and            the plurality of background objects based, at least in part,            on the respective ambient brightness levels of the plurality            of background objects.

11. The light source module of clause 10, wherein:

-   -   the controller is further configured to identify respective        distances of the plurality of background objects; and    -   the illumination pattern for the light source module is        determined based, at least in part, on the respective distances        of the plurality of background objects to the image capture        device.

12. The light source module of clause 10, wherein:

-   -   the controller is further configured to identify respective        reflectivity values of the plurality of background objects; and    -   the illumination pattern for the light source module is        determined based, at least in part, on the respective        reflectivity values of the plurality of background objects.

13. The light source module of clause 8, wherein:

-   -   the controller is further configured to identify respective        distances of one or more additional foreground objects within        the field of view of the image capture device; and    -   the illumination pattern for the light source module is        determined based, at least in part, on the respective distances        of one or more additional foreground objects.

14. The light source module of clause 8, wherein:

-   -   the image capture device comprises an imaging sensor and an        imaging lens configured to provide a plurality of focal lengths;    -   the light source module further comprises an adjustable lens        configured to project the emitted light of the plurality of        illumination elements; and    -   during the capture of the image by the image capture device, the        controller is further configured to:        -   determine a field of illumination based, at least in part,            on a configured focal length of the imaging lens and a size            of the imaging sensor; and        -   adjust the adjustable lens to the determined field of            illumination.

15. A method comprising:

-   -   configuring a light source module during capture of an image by        an image capture device, wherein the light source module        comprises a plurality of illumination elements configured to        emit light and a plurality of background illumination control        schemes, and wherein the configuring comprises:        -   identifying, within a field of view of the image capture            device, a foreground object and a background region            different from the foreground object;        -   determining an illumination pattern for the light source            module based, at least in part, on:            -   a distance of the foreground object to the image capture                device;            -   an ambient brightness level of the foreground object;            -   an ambient brightness level of the background region;                and            -   a selected background illumination control scheme of the                plurality of background illumination control schemes;                and        -   causing individual ones of the plurality of illumination            elements to respectively emit light to generate the            determined illumination pattern, wherein the individual ones            of the plurality of illumination elements are respectively            configured to emit different amounts of light based, at            least in part, on the distance of the subject to the image            capture device, the ambient brightness level of the subject            and the ambient brightness level of the background region.

16. The method of clause 15, wherein:

-   -   the selected background illumination control scheme is a        background preserving control scheme; and    -   the illumination pattern for the light source module maintains        the brightness of the background region at the ambient        brightness level of the background region and increases the        brightness of the foreground object over the ambient brightness        level of the foreground object.

17. The method of clause 15, wherein:

-   -   the configuring further comprises identifying respective        distances of one or more additional foreground objects within        the field of view of the image capture device; and    -   the illumination pattern for the light source module is        determined based, at least in part, on the respective distances        of one or more additional foreground objects.

18. The method of clause 15, wherein:

-   -   the selected background illumination control scheme is a        background compensating control scheme;    -   the configuring further comprises identifying respective ambient        brightness levels of a plurality of background objects in the        background region; and    -   the illumination pattern for the light source module provides        differing illumination to the foreground object and the        plurality of background objects based, at least in part, on the        respective ambient brightness levels of the plurality of        background objects.

19. The method of clause 18, wherein:

-   -   the configuring further comprises identifying respective        distances of the plurality of background objects; and    -   the illumination pattern for the light source module is        determined based, at least in part, on the respective distances        of the plurality of background objects to the image capture        device.

20. The method of clause 18, wherein:

-   -   the configuring further comprises identifying respective        reflectivity values of the plurality of background objects; and    -   the illumination pattern for the light source module is        determined based, at least in part, on the respective        reflectivity values of the plurality of background objects.

21. A mobile computing device, comprising:

-   -   a camera arrangement comprising:        -   an image capture device;        -   a plurality of illumination elements configured to emit            light;        -   a controller for the plurality of illumination elements,            wherein during capture of an image by an image capture            device, the controller is configured to:            -   evaluate light emitted by the plurality of illumination                elements, reflected by one or more objects and detected                at the image capture device to determine respective                reflectivity values for the one or more objects;            -   determine an illumination pattern for the light source                module based, at least in part, on the respective                reflectivity values determined for the one or more                objects; and            -   cause individual ones of the plurality of illumination                elements to respectively emit light to generate the                determined illumination pattern, wherein the individual                ones of the plurality of illumination elements are                respectively configured to emit different amounts of                light based, at least in part, on the respective                reflectivity values determined for the one or more                objects.

22. The mobile computing device of clause 21, wherein:

-   -   the one or more objects comprise a foreground object and a        bounce object;    -   light emitted by a first portion of the plurality of        illumination elements is reflected by the bounce object to the        foreground object, then reflected from the foreground object to        the image capture device;    -   additional light emitted by a second portion of the plurality of        illumination elements is reflected by the foreground object to        the image capture device;    -   the illumination pattern for the light source module illuminates        the foreground object;    -   the first portion of the plurality of illumination elements is        configured to emit a first amount of light based, at least in        part, on a reflectivity value for the bounce object; and    -   the second portion of the plurality of illumination elements is        configured to emit a second amount of light different from the        first amount of light.

23. The mobile computing device of clause 22, wherein:

-   -   the light source module further comprises an adjustable lens        configured to project the emitted light of the plurality of        illumination elements;    -   the bounce object is outside a field of view of the image        capture device; and    -   the controller is further configured to adjust the adjustable        lens to a field of illumination that includes the bounce object.

24. The mobile computing device of clause 22, wherein:

-   -   the bounce object is identified using respective depth values        determined for the bounce object and the foreground object.

25. The mobile computing device of clause 22, wherein:

-   -   the first amount of light and the second amount of light are        respectively determined according to a configured ratio of        direct and indirect lighting.

26. The mobile computing device of clause 21, wherein:

-   -   light emitted by a first portion of the plurality of        illumination elements is reflected by a first object of the one        or more objects to the image capture device;    -   light emitted by a second portion of the plurality of        illumination elements is reflected by a second object of the one        or more objects to the image capture device;    -   the first portion of the plurality of illumination elements is        configured to emit a first amount of light based, at least in        part, on a determined reflectivity value for the first object;    -   the second portion of the plurality of illumination elements is        configured to emit a second amount of light based, at least in        part, on a determined reflectivity value for the second object;        and    -   the first amount of light and the second amount of light are        different.

27. The mobile computing device of clause 21, wherein:

-   -   the first amount of light is inversely proportional to the        determined reflectivity value for the first object; and    -   the second amount of light is inversely proportional to the        determined reflectivity value for the second object.

28. A light source module, comprising:

-   -   a plurality of illumination elements configured to emit light;    -   a controller for the plurality of illumination elements, wherein        during capture of an image by an image capture device, the        controller is configured to:        -   evaluate light emitted by the plurality of illumination            elements, reflected by one or more objects and detected at            the image capture device to determine respective            reflectivity values for the one or more objects;        -   determine an illumination pattern for the light source            module based, at least in part, on the respective            reflectivity values determined for the one or more objects;            and        -   cause individual ones of the plurality of illumination            elements to respectively emit light to generate the            determined illumination pattern, wherein the individual ones            of the plurality of illumination elements are respectively            configured to emit different amounts of light based, at            least in part, on the respective reflectivity values            determined for the one or more objects.

29. The light source module of clause 28, wherein:

-   -   the one or more objects comprise a foreground object and a        bounce object;    -   light emitted by a first portion of the plurality of        illumination elements is reflected by the bounce object to the        foreground object, then reflected from the foreground object to        the image capture device;    -   additional light emitted by a second portion of the plurality of        illumination elements is reflected by the foreground object to        the image capture device;    -   the illumination pattern for the light source module illuminates        the foreground object;    -   the first portion of the plurality of illumination elements is        configured to emit a first amount of light based, at least in        part, on a reflectivity value for the bounce object; and    -   the second portion of the plurality of illumination elements is        configured to emit a second amount of light different from the        first amount of light.

30. The light source module of clause 29, wherein:

-   -   the light source module further comprises an adjustable lens        configured to project the emitted light of the plurality of        illumination elements;    -   the bounce object is outside a field of view of the image        capture device; and    -   the controller is further configured to adjust the adjustable        lens to a field of illumination that includes the bounce object.

31. The light source module of clause 29, wherein:

-   -   the bounce object is identified using respective depth values        determined for the bounce object and the foreground object.

32. The light source module of clause 29, wherein:

-   -   the first amount of light and the second amount of light are        respectively determined according to a configured ratio of        direct and indirect lighting.

33. The light source module of clause 28, wherein:

-   -   light emitted by a first portion of the plurality of        illumination elements is reflected by a first object of the one        or more objects to the image capture device;    -   light emitted by a second portion of the plurality of        illumination elements is reflected by a second object of the one        or more objects to the image capture device;    -   the first portion of the plurality of illumination elements is        configured to emit a first amount of light based, at least in        part, on a determined reflectivity value for the first object;    -   the second portion of the plurality of illumination elements is        configured to emit a second amount of light based, at least in        part, on a determined reflectivity value for the second object;        and    -   the first amount of light and the second amount of light are        different.

34. The light source module of clause 28, wherein:

-   -   the first amount of light is inversely proportional to the        determined reflectivity value for the first object; and    -   the second amount of light is inversely proportional to the        determined reflectivity value for the second object.

35. A method comprising:

-   -   configuring a light source module during capture of an image by        an image capture device, wherein the light source module        comprises a plurality of illumination elements configured to        emit light, and wherein the configuring comprises:        -   evaluating light emitted by the plurality of illumination            elements, reflected by one or more objects and detected at            the image capture device to determine respective            reflectivity values for the one or more objects;        -   determining an illumination pattern for the light source            module based, at least in part, on the respective            reflectivity values determined for the one or more objects;            and        -   causing individual ones of the plurality of illumination            elements to respectively emit light to generate the            determined illumination pattern, wherein the individual ones            of the plurality of illumination elements are respectively            configured to emit different amounts of light based, at            least in part, on the respective reflectivity values            determined for the one or more objects.

36. The method of clause 35, wherein:

-   -   the one or more objects comprise a foreground object and a        bounce object;    -   light emitted by a first portion of the plurality of        illumination elements is reflected by the bounce object to the        foreground object, then reflected from the foreground object to        the image capture device;    -   additional light emitted by a second portion of the plurality of        illumination elements is reflected by the foreground object to        the image capture device;    -   the illumination pattern for the light source module illuminates        the foreground object;    -   the first portion of the plurality of illumination elements is        configured to emit a first amount of light based, at least in        part, on a reflectivity value for the bounce object; and    -   the second portion of the plurality of illumination elements is        configured to emit a second amount of light different from the        first amount of light.

37. The method of clause 36, wherein:

-   -   the light source module further comprises an adjustable lens        configured to project the emitted light of the plurality of        illumination elements;    -   the bounce object is outside a field of view of the image        capture device; and    -   the method further comprises adjusting the adjustable lens to a        field of illumination that includes the bounce object.

38. The method of clause 36, wherein:

-   -   the bounce object is identified using respective depth values        determined for the bounce object and the foreground object.

39. The method of clause 36, wherein:

-   -   the first amount of light and the second amount of light are        respectively determined according to a configured ratio of        direct and indirect lighting.

40. The method of clause 35, wherein:

-   -   light emitted by a first portion of the plurality of        illumination elements is reflected by a first object of the one        or more objects to the image capture device;    -   light emitted by a second portion of the plurality of        illumination elements is reflected by a second object of the one        or more objects to the image capture device;    -   the first portion of the plurality of illumination elements is        configured to emit a first amount of light inversely        proportional to a determined reflectivity value for the first        object;    -   the second portion of the plurality of illumination elements is        configured to emit a second amount of light inversely        proportional to a determined reflectivity value for the second        object; and    -   the first amount of light and the second amount of light are        different.

Multifunction Device Examples

Embodiments of electronic devices in which embodiments of light sourcemodules, camera modules, light diffusion control modules, etc. asdescribed herein may be used, user interfaces for such devices, andassociated processes for using such devices are described. As notedabove, in some embodiments, light source modules, camera modules, lightdiffusion control modules, etc. can be included in a mobile computingdevice which can include a camera device. In some embodiments, thedevice is a portable communications device, such as a mobile telephone,that also contains other functions, such as PDA and/or music playerfunctions. Other portable electronic devices, such as laptops, cellphones, pad devices, or tablet computers with touch-sensitive surfaces(e.g., touch screen displays and/or touch pads), may also be used. Itshould also be understood that, in some embodiments, the device is not aportable communications device, but is a desktop computer with atouch-sensitive surface (e.g., a touch screen display and/or a touchpad). In some embodiments, the device is a gaming computer withorientation sensors (e.g., orientation sensors in a gaming controller).In other embodiments, the device is not a portable communicationsdevice, but is a camera device.

In the discussion that follows, an electronic device that includes adisplay and a touch-sensitive surface is described. It should beunderstood, however, that the electronic device may include one or moreother physical user-interface devices, such as a physical keyboard, amouse and/or a joystick.

The device typically supports a variety of applications, such as one ormore of the following: a drawing application, a presentationapplication, a word processing application, a website creationapplication, a disk authoring application, a spreadsheet application, agaming application, a telephone application, a video conferencingapplication, an e-mail application, an instant messaging application, aworkout support application, a photo management application, a digitalcamera application, a digital video camera application, a web browsingapplication, a digital music player application, and/or a digital videoplayer application.

The various applications that may be executed on the device may use oneor more common physical user-interface devices, such as thetouch-sensitive surface. One or more functions of the touch-sensitivesurface as well as corresponding information displayed on the device maybe adjusted and/or varied from one application to the next and/or withina respective application. In this way, a common physical architecture(such as the touch-sensitive surface) of the device may support thevariety of applications with user interfaces that are intuitive andtransparent to the user.

FIG. 28 illustrates a schematic representation of an example device 4000that may include a camera and illumination array, e.g., as describedherein with reference to FIGS. 1-27 , according to some embodiments. Insome embodiments, the device 4000 may be a mobile device and/or amultifunction device. In various embodiments, the device 4000 may be anyof various types of devices, including, but not limited to, a personalcomputer system, desktop computer, laptop, notebook, tablet, slate, pad,or netbook computer, mainframe computer system, handheld computer,workstation, network computer, a camera, a set top box, a mobile device,an augmented reality (AR) and/or virtual reality (VR) headset, aconsumer device, video game console, handheld video game device,application server, storage device, a television, a video recordingdevice, a peripheral device such as a switch, modem, router, or ingeneral any type of computing or electronic device.

In some embodiments, the device 4000 may include a display system 4002(e.g., comprising a display and/or a touch-sensitive surface) and/or oneor more cameras 4004. In some non-limiting embodiments, the displaysystem 4002 and/or one or more front-facing cameras 4004 a may beprovided at a front side of the device 4000, e.g., as indicated in FIG.28 . Additionally, or alternatively, one or more rear-facing cameras4004 b may be provided at a rear side of the device 4000. In someembodiments comprising multiple cameras 4004, some or all of the camerasmay be the same as, or similar to, each other. Additionally, oralternatively, some or all of the cameras may be different from eachother. In various embodiments, the location(s) and/or arrangement(s) ofthe camera(s) 4004 may be different than those indicated in FIG. 28 .Additionally, the device 4000 may include light source modules 4018 aand/or 4018 b, which may be similar to illumination module 100 describedin FIG. 1 and light source module 220 described in FIG. 2 . In someembodiments, a controller for the light source module may be implementedin software or hardware on the device 4000.

Among other things, the device 4000 may include memory 4006 (e.g.,comprising an operating system 4008 and/or application(s)/programinstructions 4010), one or more processors and/or controllers 4012(e.g., comprising CPU(s), memory controller(s), display controller(s),and/or camera controller(s), etc.), and/or one or more sensors 4016(e.g., orientation sensor(s), proximity sensor(s), and/or positionsensor(s), etc.). In some embodiments, the device 4000 may communicatewith one or more other devices and/or services, such as computingdevice(s) 4018, cloud service(s) 4020, etc., via one or more networks4022. For example, the device 4000 may include a network interface(e.g., network interface 4210) that enables the device 4000 to transmitdata to, and receive data from, the network(s) 4022. Additionally, oralternatively, the device 4000 may be capable of communicating withother devices via wireless communication using any of a variety ofcommunications standards, protocols, and/or technologies.

FIG. 29 illustrates a schematic block diagram of an example computingdevice, referred to as computer system 4200, that may include or hostembodiments of a camera an illumination array module, e.g., as describedherein with reference to FIGS. 1-28 , according to some embodiments. Inaddition, computer system 4200 may implement methods for controllingoperations of the camera and/or for performing image processing imagescaptured with the camera. In some embodiments, the device 4000(described herein with reference to FIG. 28 ) may additionally, oralternatively, include some or all of the functional components of thecomputer system 4200 described herein.

The computer system 4200 may be configured to execute any or all of theembodiments described above. In different embodiments, computer system4200 may be any of various types of devices, including, but not limitedto, a personal computer system, desktop computer, laptop, notebook,tablet, slate, pad, or netbook computer, mainframe computer system,handheld computer, workstation, network computer, a camera, a set topbox, a mobile device, an augmented reality (AR) and/or virtual reality(VR) headset, a consumer device, video game console, handheld video gamedevice, application server, storage device, a television, a videorecording device, a peripheral device such as a switch, modem, router,or in general any type of computing or electronic device.

In the illustrated embodiment, computer system 4200 includes one or moreprocessors 4202 coupled to a system memory 4204 via an input/output(I/O) interface 4206. Computer system 4200 further includes one or morecameras 4208 coupled to the I/O interface 4206 (and associated lightsource modules). Computer system 4200 further includes a networkinterface 4210 coupled to I/O interface 4206, and one or moreinput/output devices 4212, such as cursor control device 4214, keyboard4216, and display(s) 4218.

In various embodiments, computer system 4200 may be a uniprocessorsystem including one processor 4202, or a multiprocessor systemincluding several processors 4202 (e.g., two, four, eight, or anothersuitable number). Processors 4202 may be any suitable processor capableof executing instructions. For example, in various embodimentsprocessors 4202 may be general-purpose or embedded processorsimplementing any of a variety of instruction set architectures (ISAs),such as the x86, PowerPC, SPARC, or MIPS ISAs, or any other suitableISA. Also, in some embodiments, one or more of processors 4202 mayinclude additional types of processors, such as graphics processingunits (GPUs), application specific integrated circuits (ASICs), etc. Inmultiprocessor systems, each of processors 4202 may commonly, but notnecessarily, implement the same ISA. In some embodiments, computersystem 4200 may be implemented as a system on a chip (SoC). For example,in some embodiments, processors 4202, memory 4204, I/O interface 4206(e.g., a fabric), etc. may be implemented in a single SoC comprisingmultiple components integrated into a single chip. For example, an SoCmay include multiple CPU cores, a multi-core GPU, a multi-core neuralengine, cache, one or more memories, etc. integrated into a single chip.In some embodiments, an SoC embodiment may implement a reducedinstruction set computing (RISC) architecture, or any other suitablearchitecture.

System memory 4204 may be configured to store program instructions 4220accessible by processor 4202. In various embodiments, system memory 4204may be implemented using any suitable memory technology, such as staticrandom-access memory (SRAM), synchronous dynamic RAM (SDRAM),nonvolatile/Flash-type memory, or any other type of memory.Additionally, existing camera control data 4222 of memory 4204 mayinclude any of the information or data structures described above. Insome embodiments, program instructions 4220 and/or data 4222 may bereceived, sent or stored upon different types of computer-accessiblemedia or on similar media separate from system memory 4204 or computersystem 4200. In various embodiments, some or all of the functionalitydescribed herein may be implemented via such a computer system 4200.

In one embodiment, I/O interface 4206 may be configured to coordinateI/O traffic between processor 4202, system memory 4204, and anyperipheral devices in the device, including network interface 4210 orother peripheral interfaces, such as input/output devices 4212. In someembodiments, I/O interface 4206 may perform any necessary protocol,timing or other data transformations to convert data signals from onecomponent (e.g., system memory 4204) into a format suitable for use byanother component (e.g., processor 4202). In some embodiments, I/Ointerface 4206 may include support for devices attached through varioustypes of peripheral buses, such as a variant of the Peripheral ComponentInterconnect (PCI) bus standard or the Universal Serial Bus (USB)standard, for example. In some embodiments, the function of I/Ointerface 4206 may be split into two or more separate components, suchas a north bridge and a south bridge, for example. Also, in someembodiments some or all of the functionality of I/O interface 4206, suchas an interface to system memory 4204, may be incorporated directly intoprocessor 4202.

Network interface 4210 may be configured to allow data to be exchangedbetween computer system 4200 and other devices attached to a network4224 (e.g., carrier or agent devices) or between nodes of computersystem 4200. Network 4224 may in various embodiments include one or morenetworks including but not limited to Local Area Networks (LANs) (e.g.,an Ethernet or corporate network), Wide Area Networks (WANs) (e.g., theInternet), wireless data networks, some other electronic data network,or some combination thereof. In various embodiments, network interface4210 may support communication via wired or wireless general datanetworks, such as any suitable type of Ethernet network, for example;via telecommunications/telephony networks such as analog voice networksor digital fiber communications networks; via storage area networks suchas Fibre Channel SANs, or via any other suitable type of network and/orprotocol.

Input/output devices 4212 may, in some embodiments, include one or moredisplay terminals, keyboards, keypads, touchpads, scanning devices,voice or optical recognition devices, or any other devices suitable forentering or accessing data by one or more computer systems 4200.Multiple input/output devices 4212 may be present in computer system4200 or may be distributed on various nodes of computer system 4200. Insome embodiments, similar input/output devices may be separate fromcomputer system 4200 and may interact with one or more nodes of computersystem 4200 through a wired or wireless connection, such as over networkinterface 4210.

Those skilled in the art will appreciate that computer system 4200 ismerely illustrative and is not intended to limit the scope ofembodiments. In particular, the computer system and devices may includeany combination of hardware or software that can perform the indicatedfunctions, including computers, network devices, Internet appliances,PDAs, wireless phones, pagers, etc. Computer system 4200 may also beconnected to other devices that are not illustrated, or instead mayoperate as a stand-alone system. In addition, the functionality providedby the illustrated components may in some embodiments be combined infewer components or distributed in additional components. Similarly, insome embodiments, the functionality of some of the illustratedcomponents may not be provided and/or other additional functionality maybe available.

Those skilled in the art will also appreciate that, while various itemsare illustrated as being stored in memory or on storage while beingused, these items or portions of them may be transferred between memoryand other storage devices for purposes of memory management and dataintegrity. Alternatively, in other embodiments some or all of thesoftware components may execute in memory on another device andcommunicate with the illustrated computer system via inter-computercommunication. Some or all of the system components or data structuresmay also be stored (e.g., as instructions or structured data) on acomputer-accessible medium or a portable article to be read by anappropriate drive, various examples of which are described above. Insome embodiments, instructions stored on a computer-accessible mediumseparate from computer system 4200 may be transmitted to computer system4200 via transmission media or signals such as electrical,electromagnetic, or digital signals, conveyed via a communication mediumsuch as a network and/or a wireless link. Various embodiments mayfurther include receiving, sending or storing instructions and/or dataimplemented in accordance with the foregoing description upon acomputer-accessible medium. Generally speaking, a computer-accessiblemedium may include a non-transitory, computer-readable storage medium ormemory medium such as magnetic or optical media, e.g., disk orDVD/CD-ROM, volatile or non-volatile media such as RAM (e.g., SDRAM,DDR, RDRAM, SRAM, etc.), ROM, etc. In some embodiments, acomputer-accessible medium may include transmission media or signalssuch as electrical, electromagnetic, or digital signals, conveyed via acommunication medium such as network and/or a wireless link.

The methods described herein may be implemented in software, hardware,or a combination thereof, in different embodiments. In addition, theorder of the blocks of the methods may be changed, and various elementsmay be added, reordered, combined, omitted, modified, etc. Variousmodifications and changes may be made as would be obvious to a personskilled in the art having the benefit of this disclosure. The variousembodiments described herein are meant to be illustrative and notlimiting. Many variations, modifications, additions, and improvementsare possible. Accordingly, plural instances may be provided forcomponents described herein as a single instance. Boundaries betweenvarious components, operations and data stores are somewhat arbitrary,and particular operations are illustrated in the context of specificillustrative configurations. Other allocations of functionality areenvisioned and may fall within the scope of claims that follow. Finally,structures and functionality presented as discrete components in theexample configurations may be implemented as a combined structure orcomponent. These and other variations, modifications, additions, andimprovements may fall within the scope of embodiments as defined in theclaims that follow.

What is claimed is:
 1. A mobile computing device, comprising: a cameraarrangement comprising: an image capture device; a plurality ofillumination elements configured to emit light; a lens configured toproject the emitted light of the plurality of illumination elementsaccording to a field of illumination; and a controller, wherein duringcapture of an image by the image capture device, the controller isconfigured to: determine the field of illumination and an associatedillumination pattern based, at least in part, on a profile of theimaging device, the profile comprising a field of view and anillumination sensitivity model; and cause individual ones of theplurality of illumination elements to respectively emit light throughthe lens to generate the determined illumination pattern, wherein theindividual ones of the plurality of illumination elements arerespectively configured to emit different amounts of light based, atleast in part, on the illumination sensitivity model of the profile forthe imaging device.
 2. The mobile computing device of claim 1, wherein:the image capture device comprises an imaging lens and an imagingsensor; the field of view of the profile is determined by a focal lengthof the imaging lens, a size of the imaging sensor; and the illuminationsensitivity model of the profile is based, at least in part, on one ormore characteristics of an image rendered by the imaging lens onto theimaging sensor.
 3. The mobile computing device of claim 2, wherein thefield of view of the profile is further determined based on auser-defined crop or zoom.
 4. The mobile computing device of claim 3,wherein: the image capture device is configured to provide a pluralityof zoom levels; the profile of the imaging device is one of a pluralityof profiles determined according to respective configured zoom level ofthe image capture device; the field of view of the profile is determinedby a configured zoom level of the image capture device; and theillumination sensitivity model of the profile is based, at least inpart, on the one or more characteristics of the image rendered by theimaging lens onto the imaging sensor at the configured zoom level;wherein respective sensitivity models of respective profiles of theplurality of profiles determined at different zoom levels are different.5. The mobile computing device of claim 2, wherein the one or morecharacteristics of the image rendered by the imaging lens onto theimaging sensor comprise at least a vignetting characteristic associatedwith the imaging lens.
 6. The mobile computing device of claim 1,wherein the plurality of illumination elements is a two-dimensionalarray of illumination elements.
 7. The mobile computing device of claim1, wherein the controller is further configured to determine theillumination pattern according to one or more objects identified in thefield of view of the imaging device.
 8. A light source module,comprising: a plurality of illumination elements configured to emitlight; a lens configured to project the emitted light of the pluralityof illumination elements according to a field of illumination; and acontroller, wherein during capture of an image by an image capturedevice, the controller is configured to: determine the field ofillumination and an associated illumination pattern for the light sourcemodule based, at least in part, on a profile of the imaging device, theprofile comprising a field of view and an illumination sensitivitymodel; and cause individual ones of the plurality of illuminationelements to respectively emit light through the lens to generate thedetermined illumination pattern, wherein the individual ones of theplurality of illumination elements are respectively configured to emitdifferent amounts of light based, at least in part, on the illuminationsensitivity model of the profile for the imaging device.
 9. The lightsource module of claim 8, wherein: the lens is an adjustable lens; andthe controller, during capture of an image by an image capture device,is further configured to adjust the adjustable lens to the determinedfield of illumination based, at least in part, on the field of view ofthe profile for the imaging device.
 10. The light source module of claim8, wherein: the image capture device comprises an imaging lens and animaging sensor; the field of view of the profile is determined by afocal length of the imaging lens and a size of the imaging sensor; andthe illumination sensitivity model of the profile is based, at least inpart, on one or more characteristics of an image rendered by the imaginglens onto the imaging sensor.
 11. The light source module of claim 10,wherein the field of view of the profile is further determined based ona user-defined crop or zoom.
 12. The light source module of claim 11,wherein: the imaging lens is configured to provide a plurality of zooms;the profile of the imaging device is one of a plurality of profilesdetermined according to respective configured zooms of the imagingcapture device; the field of view of the profile is determined by aconfigured zoom of the imaging capture device; and the illuminationsensitivity model of the profile is based, at least in part, on the oneor more characteristics of the image rendered by the imaging lens ontothe imaging sensor at the configured zoom; wherein respectivesensitivity models of respective profiles of the plurality of profilesdetermined at different zooms are different.
 13. The light source moduleof claim 11, wherein the one or more characteristics of the imagerendered by the imaging lens onto the imaging sensor comprise at least avignetting characteristic associated with the imaging lens.
 14. Thelight source module of claim 8, wherein to determine the field ofillumination and the associated illumination pattern for the lightsource module, the controller is configured to evaluate a focusingdistance of the imaging lens and a crop of the imaging sensor.
 15. Thelight source module of claim 8, wherein the plurality of illuminationelements is a two-dimensional array of illumination elements.
 16. Thelight source module of claim 8, wherein the controller is furtherconfigured to determine the illumination pattern according to one ormore objects identified in the field of view of the imaging device. 17.A method comprising: configuring a light source module during capture ofan image by an image capture device, wherein the light source modulecomprises a plurality of illumination elements configured to emit lightand a lens configured to project the emitted light of the plurality ofillumination elements, and wherein the configuring comprises:determining a field of illumination and an associated illuminationpattern for the light source module based, at least in part, on aprofile of the imaging device, the profile comprising a field of viewand an illumination sensitivity model; and causing individual ones ofthe plurality of illumination elements to respectively emit lightthrough the lens to generate the determined illumination pattern,wherein the individual ones of the plurality of illumination elementsare respectively configured to emit different amounts of light based, atleast in part, on the illumination sensitivity model of the profile forthe imaging device.
 18. The method of claim 17, wherein: the imagecapture device comprises an imaging lens and an imaging sensor; thefield of view of the profile is determined by a focal length of theimaging lens and a size of the imaging sensor; and the illuminationsensitivity model of the profile is based, at least in part, on one ormore characteristics of an image rendered by the imaging lens onto theimaging sensor.
 19. The method of claim 17, wherein to determine thefield of illumination and the associated illumination pattern for thelight source module, the controller is configured to evaluate a focusingdistance of the imaging lens, and a crop of the imaging sensor.
 20. Themethod of claim 17, further comprising: configuring the light sourcemodule during adding light to an environment as a flashlight, whereinthe configuring comprises: determining a field of illumination and anassociated illumination pattern for the light source module based, atleast in part, on a user's intended beam width, pattern, or intensity asindicated to a controller through a graphical user input; and causingindividual ones of the plurality of illumination elements torespectively emit light through the lens to generate the determinedillumination pattern, wherein the individual ones of the plurality ofillumination elements are respectively configured to emit differentamounts of light based, at least in part, on the user's intended beamwidth, pattern, or intensity that were sent to the controller throughthe graphical user input.